Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

write_tsdb plugin: Export metadata. #1655

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

kev009
Copy link
Contributor

@kev009 kev009 commented Apr 6, 2016

Merge conflict resolution and fixes for @rubenk review

@kev009 kev009 mentioned this pull request Apr 6, 2016
}

pthread_mutex_lock (&orig->lock);
for(e=orig->head; NULL != e; e = e->next) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You missed this one.

@kev009
Copy link
Contributor Author

kev009 commented Apr 6, 2016

@rubenk hmm, can you review/merge #1656 and I will rebase, I think it should take care of these concerns

@rubenk
Copy link
Contributor

rubenk commented Apr 6, 2016

@kev009 I did review #1106 yesterday, see #1106 (comment)

@kev009
Copy link
Contributor Author

kev009 commented Apr 6, 2016

@rubenk My mistake, #1656 is the updated PR

@rubenk
Copy link
Contributor

rubenk commented Apr 6, 2016

Ok, so this one can be closed?

@kev009
Copy link
Contributor Author

kev009 commented Apr 6, 2016

@rubenk this is additive on #1656, if that PR is accepted this one will get smaller

@kev009
Copy link
Contributor Author

kev009 commented Apr 6, 2016

Ok, this is mergable, if anyone desires any change/squash of git history I am happy to accommodate.

I'm going to try and look harder at all this based on @mfournier's comment in #1656, but this PR shouldn't need any changes as long as the meta_data API stays the same.

@mattj-io
Copy link

mattj-io commented Apr 15, 2016

Any news on this being merged, we're really keen to use it without building our own packages

@ntirupattur
Copy link

Looking forward to this feature being merged.

@kev009
Copy link
Contributor Author

kev009 commented May 29, 2016

@rubenk I'm thinking this should be merged as it stands, and we can look into perf of metadata later on

@rubenk
Copy link
Contributor

rubenk commented May 29, 2016

I'm not too worried about the performance aspect. What does worry me is the raciness and memory leak as mentioned in #1656 (comment)

I'd rather address those before this goes into the tree than after, since if there are design issues, they are going to be much harder to fix when we have existing users of this feature.

@mfournier mfournier modified the milestone: 5.6 Aug 2, 2016
@octo octo added the Feature label Aug 11, 2016
@octo octo modified the milestones: Features, 5.6 Aug 15, 2016
@octo
Copy link
Member

octo commented Aug 15, 2016

Sorry, but this is a bit too stale to rush this into 5.6. Our current plans are to release 5.7 in December, this PR should make it into that I hope.

@octo octo modified the milestones: 5.7, Features Aug 15, 2016
@todd-richmond
Copy link

we have been using this in production w/o problem - definitely critical to support query drill-downs for values with large entry count when using Grafana

@octo
Copy link
Member

octo commented Sep 15, 2016

FYI, this features like this one have been requested for a number of write plugins. Right now, the meta data is an internal concept only. We're not opposed to exporting this, but we'd like to do it right. There should be a design and discussion before we start accepting such changes into the codebase. I'll likely create a feature request issue to track this and write up a design proposal. Stay tuned.

Best regards,
—octo

@octo octo changed the title write_tsdb with metadata write_tsdb plugin: Export metadata. Sep 15, 2016
@sterfield
Copy link

Hey guys,

Any news on this PR ? Is there any decision taken ?

Thanks a lot,

@octo
Copy link
Member

octo commented Nov 27, 2016

I've pulled out the DNS changes into #2059. @kev009, could you please enable maintainer edits so I can rebase this PR and remove the unrelated DNS commits from here? Thanks!

@kev009
Copy link
Contributor Author

kev009 commented Nov 27, 2016

Enabled

@octo octo force-pushed the opentsdb_with_metadata branch 2 times, most recently from ad01371 to 8c51cbc Compare November 29, 2016 14:06
@octo
Copy link
Member

octo commented Nov 29, 2016

I've rebased the code on master and reformatted with clang-format.

@kev009
Copy link
Contributor Author

kev009 commented Feb 17, 2017

@octo what is the architecture path forward here? It seems like many types of metrics stores benefit greatly from this principle of plugins to push metadata, but there needs to be clear direction for feeding it from collectd and plugins.

@annakepler
Copy link

Is there a plan to go forward with this feature? our team can really use this feature.

@kev009
Copy link
Contributor Author

kev009 commented Feb 26, 2018

@octo @rubenk I have some time right now to getting this across the finish line if we can figure out the right architecture to do it

@bzed
Copy link
Contributor

bzed commented Nov 11, 2019

@kev009 @octo any news here?

@kev009
Copy link
Contributor Author

kev009 commented Nov 15, 2019

@bzed no progress, I need someone to help brainstorm the design due to time constraints. Happy to update this once we have an API design figured out.

@collectd-bot collectd-bot changed the base branch from master to main July 3, 2020 09:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet